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SPECIFICATION 



SELECTABLE BANDWIDTH FACILITY FOR A NETWORK PORT 



Field of the Invention 

This invention relates to data communication networks for the conveyance of data 
packets between users, such as computers, file servers, work stations and such like 
Networks of this character are commonly composed not only of the end users but also 
various multiport units such as hubs, switches and routers 

Background of the Invention 

Some of the units from which a network is composed are essentially passive in the sense 
that they are intended merely to pass on or distribute without discrimination packets that 
they receive Other units, particularly bridges and routers, are more complex devices 
and commonly include management agents by means of which control over the data 
packets passing through the switch may be exercised 

In recent years many developments have occurred in the implementation of packet based 
networks and in particular in networks conforming to the 'Ethernet' Standards For 
example, the permitted maximum speeds of communication which can be achieved have 
increased and standards are now in existence which permit communications to occur at a 
variety of different speeds Devices are available which are capable of operating at a 
multiplicity of different rates, such as for example 10 or 100 or 1000 Mbps selectively 
It is known to provide on network units ports, and associated media access control 
devices (MACs) which are selectively controllable to operate at any one of a variety of 
different speeds so that a user may take advantage of a multiplicity of different operating 
capabilities 

Nevertheless, it is for a variety of reasons desirable to be able to restrict arbitrarily the 
bandwidth available to a user to some figure less than the rate or selected rate at which a 
communication link could operate For example, many network administrators do not 
desire their users to have access to high speed networks because allowing such access 



may dramatically increase the load on existing file servers, routers and wide area 
network links These reasons may be sufficient to prevent network administrators from 
installing multiple speed switches 

It is therefore generally desirable to provide a feature that can put an upper limit on the 
bandv^'idth permitted at an individual port of a switch For example, a network 
administrator may install a switch that is capable at individual ports of operation at a 
multiplicity of different rates, such as 10Mbps and 100Mbps, but configure the switch 
such that certain ports are limited to an actual throughput of (for example) 6Mbps and 
other ports are limited to 20Mbps 

General State of the Art 

It is known to limit the bandwidth available for packets to be transmitted over a link 
from a port by using a 'leaky bucket' which is decremented at a selectable rate and is 
incremented at a rate dependant on the traffic (i e the packets) dispatched from the port 
Transmission of packets is inhibited if the value held m the counter exceeds a threshold 
Such a system is disclosed by Harwood in United States Patent 5604867 issued 18 
February 1997 It is also known to provide a system in which a peak bit rate is 
monitored in a first ieaky bucket' unit and the duration of peak rate bursts is monitored 
in a second 'leaky bucket" Such an arrangement is shown in Kammerl, United States 
patent 5339332 

It is also known to provide a ieaky bucket' which is decremented at a selectable rate and 
is incremented in accordance with traffic both sent from and received by a respective 
port of a switch. Such a system is disclosed in GB published application GB-23 36076 

It is customary in devices such as network switches, bridges and routers to store packets 
after they have been received and before they are transmitted from their destination port 
or ports Very typically the packets are held in queues, constituted by the packet 
themselves or by queues of pointers for the packets, and it is well known to control the 
dispatch of packets from a queue either m accordance with conditions within the switch 



or by virtue of control frames received at a particular port Accordingly, there is m most 
commercially available switches a mechanism which enables the transmission of 
switches from a particular port to be selectively inhibited. 

It is also known to restrict the reception of packets at a particular port In the present 
invention a reduction in bandwidth of packets received by the switch, is preferably 
achieved by inhibiting the reception of packets by signalling to a link partner, i e the 
provider of packets at the other end of a link to a particular port This activity is well 
known in the art and is, for example, specified in a transmission standard such as IEEE 
802 3 (1998 Edition) for Ethernet packets In that standard, the sending of a particular 
control frame with a conventional address and particular operation code must, according 
to the standard, be interpreted by a receiver of such a frame (i e the link partner) as an 
instruction to cease sending frames or packets for a selectable time specified in the 
control frame Such a frame (or its equivalent in other standards) will hereinafter be 
described as a ^ pause frame' 

Summary of the Invention 

The present invention particularly concerns a versatile bandwidth controller by means of 
which at a particular port the bandwidth available for reception of packets and the 
forwardmg of packets can be either separately or conjointly controlled The former, 
called herein the duplex mode, would be more suitable when the transmission link is 
duplex (allowing simultaneous transmission and reception) and the latter would be more 
suitable when the transmission link were half-duplex (not allowing simultaneous 
transmission and reception) For this reason the two modes will be termed 'duplex' and 
half-duplex' but it is not essential that the mode of the bandwidth controller be the same 
as that of the link The link may be a duplex link but the bandwidth controller could be in 
a half-duplex mode if desired 

To this end a preferred embodiment of the invention employs two token buckets- which 
can be configured so that the transmission and reception bandwidths may, according to 
the selected mode, be controlled separately or conjointly Preferably prevention of 



transmission and restriction of reception of packets may, according to the mode of the 
bandwidth controller, be subject to a single threshold or respective thresholds 

Flow control, namely the sending of pause frames over a link and responding to pause 
frames, is contmonly employed to relieve congestion in a switch The sending of pause 
frames over a link is inherently a manner of bandwidth control The present invention 
provides bandwidth control which is not dependent on congestion within a switch but 
can be imposed externally by a network administrator using conventional control frames 

It will be understood that in the present invention, as in many other counting systems 
subject to a threshold, the significance of the terms 'above' and 'below' a threshold 
depends on the relationship (which may be arbitrary) between the threshold and the 
direction of counting associated with an increase in traffic In the specific example 
described later, the passage of excess traffic is indicated by a net count below a 
threshold, but a converse convention could be employed Stated alternatively the token 
buckets could be constituted by leaky' buckets For this reason the term 'in-profile' is 
employed herein to indicate a count which will allow more traffic and 'out-of profile' is 
employed to indicate a count which will cause inhibition of traffic 

Other features of the invention will become apparent from the following description, 
with reference to the accompanying drawings 

Brief Description of the Drawings 

Figure 1 is a general schematic illustration of a switch unit within which the present 
invention maybe incorporated 

Figure 2 is a schematic diagram illustrating one embodiment of the present invention 

A typical context for the present invention is a multiport switch of the kind which is 
illustrated in Figure 1 The particular architecture of the switch or other unit within 
which the invention may be incorporated is not important The present invention will be 



described in relation to 'Ethernet' networks and more particularly those conforming to 
IEEE Standard 802 3, though such a restriction is not crucial to the present invention 

A switch 10 as shown m Figure 1 typically has a multiplicity of ports, 1 la to 1 Ih These 
ports may be in known form for coupling to transmission media Each port is associated 
with a respective media access control device (MAC) 14a to 14h likewise in known 
form For present purposes it may be presumed that the media access control devices 
conform to the requirements of IEEE Standard 802 3 They may be controllable to 
provide a multiplicity of transmission rates, such as 10/ 100/1 000Mbps. Selection of a 
particular rate may be imposed by means of control frames or may be established by auto 
negotiation in a manner well known in itself (and described in the aforementioned IEEE 
Standard) 

The remainder of the switch shown in Figure 1 is shown in schematic form only 
Broadly, it comprises a bus system 13 by means of which data packets are sent for 
temporary storage m memory 14 and subsequently dispatched from memory to a 
destination port or ports A bus system 1 5 between the media access control devices and 
processing engines 16 is provided for signalling the processing engines and also exerting 
control over the individual MACs Such control is required for determining the 
destination of packets, and derives from both control frames received by the switch and 
internal operations such as the performing of lookups on address data within the packets 
and so on 

The basis of the system 20 shown in Figure 2 is that for a port (preferably but not 
necessarily each port of the switch in Figure 1), the received and transmitted streams of 
traffic are controlled using one or two token buckets, depending on the mode The 
'mechanism' (which may be software-based) is octet-based and can cater for bursty 
traffic patterns 

Preferably, there are tv^o modes of operation One is a full duplex mode in which two 
token buckets are employed The first controls the traffic transmitted from the port by 
inhibiting the release from storage of packets intended for that port The second token 
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bucket restricts the traffic received by the port, preferably by means of the dispatch of 
pause frames 

A second mode of operation is a half-duplex mode Here, a single token bucket is used 
5 lo meter the combined traffic received and transmitted by the port 

The system configures the token buckets to detect situations where the relevant traffic is 
in excess of a chosen threshold Preferably the 'granularity' of the threshold for 
operation at 10 or 100Mbps is at 1Mbps intervals For ports which are operable at 
10 1000Mbps the granularity of the threshold could be greater, such as 10Mbps 

While the traffic is below the threshold, a state termed herein 'in profile', then packets 
are received and/or transmitted normally without restriction by the token bucket system. 
If the relevant traffic exceeds the threshold, a state termed herein 'out of profile', then 
15 action is taken to stem the flow of traffic. 

For the duplex mode, while the relevant token bucket indicates that the transmitted 
traffic is 'out of profile', then the MAC 14 is instructed to temporarily stop transmitting 
frames If the MAC is instaicted to stop during the transmission of a frame, then (as is 
20 usual), the frame is transmitted normally Transmission of frames may be resumed when 

the token bucket indicates that the transmh traffic is once again in profile' 

Also in the Ml duplex mode, while the respective token bucket indicates that the 
received traffic is 'out of profile', the MAC 14 is instructed to flow control incoming 
25 traffic using normal flow control methods, such as pause frames in accordance with 

pause frames This flow control can be disabled when the received token bucket 
indicates that the traffic is once again 'in profile' 



30 



'When the system is in half-duplex mode, while the single token bucket indicates that the 
combined traffic is 'out of profile', the MAC 14 is instructed not only to temporarily 
stop transmitting frames but also to flow control incoming traffic as described above 
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There follows a description of the elements shown in Figure 2 The MAC 14 is a normal 
Ethernet media access control device The MAC 14 is coupled to a monitor 21 which, 
in accordance with known techniques, sends data all frames which are transmitted and 
received through the MAC. For each valid frame transmitted or received by the MAC, 
5 the frame size (in terms of byte count) and the direction (transmitted or received) is 

passed to a processing engine 22 The byte count and direction maybe transmitted as a 
data word having an appropriate operation code, one field denoting byte count and a 
smaller field (vv'hich may be a 1 byte field) indicating direction 

10 The processing engine 22 controls and reads configuration registers 23 (to be described) 

and two token buckets 24 and 25 Processing engme 22 will read the mode 
configuration in the configuration registers and update the appropriate token bucket 
Processing engine 26 also reads the mode configuration in the configuration registers 
and checks whether the token buckets 24 and 25 are above or below their respective 

IS counting thresholds The threshold, which may be 'hard -wired' or set by software, 

defines a token count which is at the choice of the designer but would be somewhat 
greater than the maximum size of a packet expressed on terms of tokens As is described 
later, processing engine 26 asserts signals to a receive inhibit control (RXI) 27 and a 
transmit inhibit control (TXI) 28 

20 

Receive control 27, while the signal from processing engine 26 is asserted, inhibits the 
reception of more traffic by the MAC by generating a pause frame in accordance with 
the IEEE Standard 802 3 The duration specified in the pause frame is a matter of design 
choice The transmit control while the signal from processing engine 26 is asserted, 
25 prevents the transmission of more traffic by the MAC by generating an inhibit that 

prevents frames being transferred from the transmit store 29 to the MAC If the signal 
from engine 26 is asserted while a packet is in transit, the inhibit would be applied to the 
next packet 

30 In this embodiment of the invention, frames received by the MAC are stored m a receive 

store 30 and frames which are intended for transmission from the port are stored in a 
transmit storage space 29 These may be, in accordance with known practice, buffer 



stores associated (temporarily or permanently) with the MAC for the particular port 
Alternatively they may be allotted storage space m memory 14 

Each token bucket 24 and 25 is shown explicitly in Figure 2, but may be constituted by 
relevant fields, as discussed below, m storage locations and be both defined and 
controlled by software, in accordance with the following description 

Each token bucket contains a number of 'tokens', namely a specific numerical count 
which is related to the relevant unit of measurement of traffic flow In this example it 
will be assumed that one token is equal to I byte The size of the fields and thereby of 
the counters can be reduced if a token is equivalent to a muhiplicity of bytes This 
results in a loss of accuracy but for high speed measurement may be appropriate to avoid 
excessively large counters 

In a token bucket, at regular intervals new 'tokens' are added to the bucket, specifically a 
'refresh count" A specific number of tokens are required to perform an operation, 
namely to send a packet or receive a packet When the operation is performed the 
requisite tokens are removed from the bucket The operation cannot be performed unless 
there are sufficient tokens in the bucket, i e the bucket count exceeds a threshold 

In the present example, each token bucket is defined by four fields These are illustrated 
for bucket 24 schematically as Fi to F4 along with a 'field' F5 which represents the 
threshold As previously mentioned, this 'field' may be a hard-wired value but could be, 
like fields Fi to F4 , set in a software controlled register 

A first field, the 'in-profile' field Fi consisting of one bit, indicates whether the token 
bucket is 'in profile", if the bucket count is less than a specified threshold, or whether the 
token bucket is out of profile 

A second field F7, 'bucket size', having in this example three bits is a configurable value 
specifying the maximum number of tokens allowed in the bucket (typically values from 
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512 to 64k tokens) These values determine the maximum 'burst' of data which can be 
allowed before the token bucket becomes 'out of profile' 

The third field is a 'refresh count', a seven bit field which indicates the number of 
5 tokens that are to be added to the bucket for each refresh interval 

The refresh mterval may be fixed or variable but in the present embodiment it is assumed 
that the refresh interval is fixed and is determined by a selected clock from the 
processing engine 22 to the token bucket 

10 

The fourth field F4 of the token bucket is the 'bucket count' herein defined by a sixteen 
bit field, representing the current count of tokens in the bucket The count is reduced by 
incoming packets and is increased by the 'refresh count' every refresh inter\'al, typically 
8 microseconds 

15 

In the present example, the system includes a configuration register 23 which is 
controlled accordmg to whether the mode of operation of the port is duplex or half- 
duplex The configuration register may be put in this mode as a resuh of the auto 
negotiation performed but it is readily possible, since the configuration registers may be 
20 set by software, to impose the configuration and the other fields on the token buckets by 

means of management frames sent to the port 

Whichever scheme is adopted for the control of the configuration registers and the token 
buckets, the configuration register 23 in combination with processing engine 26 
25 determines two distinct modes of operation for the token buckets, namely full duplex 

mode and half- duplex mode 

In the duplex mode, the restriction of transmission of packets and the inhibition of 
reception of packets are separately controlled by the token buckets 24 and 25 Thus an 
30 in profile/out of profile' signal from token bucket 24 determines the command signal to 

transmit control 28 whereas the 'in profile/out of profile' signal from the token bucket 25 
determines the command signal to receive control 27 More particularly, while the 
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' transmit' token bucket 24 indicates that the transmitted traffic is 'out of profile', control 
28 prevents transfer of frames from transmit storage 29 to the port In practice transmit 
control 28 instructs MAC 20 not to accept frames from transmit storage 29 As a 
practical matter, if the MAC is instructed to stop during the transmission of the frame, 
then that particular frame is transmitted normally and cessation of transmission seizes for 
the next frame Transmission will be resumed when the 'transmit' token bucket 
indicates that the transmit traffic is once again 'in profile' 

Also in the full duplex mode, while the 'receive' token bucket indicates that the receive 
traffic is 'out of profile', then receive control 27 commands the MAC to produce pause 
frames as previously described Flow control will be disabled when the receive token 
bucket indicates that the receive traffic is once again 'in profile' 

The action of the processing engine to control the signalling of controls 27 and 28 is 
predetermined by the configuration register 23 

For the sake of example, when the token bucket is first started, the 'bucket count' may 
be set to the in profile threshold (such as 0x0800 tokens) Ahernatively if an initial burst 
of traffic is acceptable, 'bucket count' could be set to a maximum for the chosen bucket 
size, e g OxFFF Every 8 microseconds, refresh tokens may be added to the bucket 
count There are two options here Option (a) requires that refresh tokens will be added 
to the bucket count and if the bucket count increases above the 'bucket size' the bucket 
count is set to the bucket size Option (b) requires that only if the bucket count is less 
than the bucket size, the refresh count tokens are added to the bucket count Either option 
ensures that the bucket count does not wrap around to a low number When a packet 
completely arrives, the respective number of tokens is calculated If the bucket count is 
greater than the in profile threshold, the calculated number of tokens is subtracted from 
the bucket count If the new bucket count is equal to or less than the in profile threshold, 
the bucket is judged 'out of profile' and the appropriate traffic inhibiting signals will be 
produced Otherwise the bucket count will not be changed 



In the full duplex mode, the bandwidth occupancy which is controlled will be the sum of 
the traffic to and from the port However, for a variety of purposes that control may be 
too restrictive and the benefit of the present invention lies in the choice between that full 
duplex mode and the half-duplex mode 

In the half-duplex mode configuration register 23 sets processor 22 to cause 
accumulation of the byte count, irrespective of direction, in one of the token buckets, for 
example token bucket 24 Configuration register 23 also controls processing engine 26 
so that when the threshold for token bucket 24 is exceeded, commands are sent both to 
transmit control 28 and receive control 27 so as to ensure that the MAC is instructed 
both to temporarily stop transmitting frames and also to exert flow control on the 
incoming traffic 

The present invention, by providing two token buckets which can control both 
transmitted and received bandv^'idth occupancy separately or as combined provides a 
more versatile system for scaleabie control of bandwidth and in the prior art 

Degrees of sophistication are feasible For example, it is not necessary that the 
thresholds in buckets 24 and 25 be the same The configuration register could provide a 
choice between the token buckets to be used for the full duplex mode. 



